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ABSTRACT 

Beginning with a review of relevant literature on 
learning and computers, this report focuses on a group of five second 
graders in the process of creating a multimedia presentation for 
their class. Using "StoryShow, software that combines images, sound, 
and text, the students took on a variety of production roles. Each 
one contributed at least one image and sound element to the final 
composition. Each task the students performed — manipulating hardware 
or software, choosing images from books or directing other 
students — was essential to the overall success of the composition, 
but the role of director, taken on by one girl in the group, became 
the key to its completion. The success of this episode was 
facilitated, in part, by the teacher's interpretation of how the 
software might be used, and a classroom environment that supported 
the kinds of independent and collaborative activities that the 
software encouraged. The research method employed in this study is 
micro-ethnographic; and the objectives were to understand classroom 
learning activities from the point of view of the participants, to 
describe how innovative educational tools move from design to actual 
use, and to show how that knowledge may be applied to future designs. 
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The Study 



This study focuses on five 
2tid graders creating a 
multimedia presentation 
with *StoryShow, ' a software 
application for combining 
images, sound and text. 



Each task performed 
was essential but the 
director's role became 
pivotal to completion of 
the assignment. 



Technology changes the kinds 
of text children interact with 
and the kinds of interactions 
children have with text when 
it is widely used in reading 
and writing. 



Research literature 
shows that technology is 
interpreted according : 
the relationships that alrt V 
existed among teachers and 
students before technology 
was introduced. 
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Begun in 1985, Apple Classrooms of Tomorrow (ACOT)^-^ is a research and 
development collaboration among public schools, universities, research agen- 
cies and Apple Computer, Inc. ACOT explores, develops and demonstrates the 
powerful uses of tedinologies in teaching and learning. In all ACOT endeavors, 
instruction and assessment are as integral to learning as technology. 

Supporting a constructivist approach to learning, technology is used as 
knowledge-building tools. As students collaborate, create media-rich composi- 
tions and use simulations and models, researchers investigate four aspects of 
learning: tasks, interactions, situations and tools. The research is formative. The 
findings guide ACOT staff and teachers as they refine their approach to learning, 
teaching and professional development ACOT teachers and students often use 
the most advanced technologies available, including eq)erimental technologies, 
to help us envision the future and improve the educational process. 

ACOT views technology as a necessary and catalytic part of the effort 
required to fundamental restructure America's education system. We hope that 
by sharing our results with parents, educators, policy makers, and technology 
developers the lessons of ACOT will contribute to the advancement of educa- 
tional reform. 

Abstract 

B^^nning with a review of relevant literature on learning and computers, this report 
focuses on a group of five second graders in the process of creating a multimedia presenta- 
tion for their class. Using software that combines images, sound and text, the students took 
on a variety of production roles. Each one contributed at least one image and sound element 
to the final composition. Each task the students perfbrmed-^nanipulating hardware or soft- 
ware, choosing images fit^m books or directing other students-^was essential to the overall 
success of the composition, but the role of direaor, taken on by one girl in the group, 
became the key to its completion. 

The success of this episode was facilitated, in part, by the teacher's interpretation of how 
the software might be used, and a classroom environment that supported the kinds of inde- 
pendent and collaborative activities that the software encouraged 

introduction 

According to \'ygotsky (1978), the tools that we use to manipulate signs ~ in the form of 
language or other symbol systems — mediate our interactions with the woria and restructure * 
our mental activity. In human societies, people perform numerous tasks with the aid of tools 
as simple as hammers and saws or as complex as writing systems. As people use these tools, 
they bring changes to both the worid around them and to the psycholo^cal processes and 
representations that underlie the activities (Vygotsky, 1978; Ntoin & Scribner, 1988). 

Techi'iology — when widely used for children's reading and writing activities — is chang- 
ing the kinds of interactions children have with text, as well as the kinds of texts with which 
they interaa New computer-based tools combine text, sound, image and video in various 
ways — as in videodiscs and video games — providing new methods for creating texts. In this 
report, we see how a multimedia composition tool designed specifically for children was 
used by a group of five students in a second grade classroom. 
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How each individual child 
uses a computer will always 
be closely connected to the 
social relationships existing 
in the classroom. 



Children who play video 
games and watch television, 
have an intertextual world 
that stretches beyond the 
book, to include particular 
characters and stories as 
well as particular ways of 
interacting with texts. 



Collaborative tools can help 
people produce something 
together that no one person 
could produce working 
alone. 



How tools are designed will 
influence the ways students 
can collaborate. 



Apple Classrooms of Tomorro*^ 



Innovations and Classrooms 

Any technology is conceived, developed and employed in a particular social context, and 
the influence it has depends greatly upon how it is used in a given environment Putting a 
computer in a classroom is not likely to lead to changes in learning unless the computer- 
based activities relate closely to the kinds of activities already taking place in that classroom. 

In Mehan's (1989) study of the use of single microcomputers in four classrooms, he 
describes how the technology was used in very different ways by each teacher, leading to dif- 
ferent changes in classroom activiiy. Mehan argues that the social structure of the classroom 
is the key element in understanding how technology will be used Although particular uses of 
techndogy may encourage participation, the most important feaor is not the computer and 
the software, but what is done with them. 

Similar conclusions are drawn by Hawkins (1987) in an analysis of Logo use by teachers 
and students, by Genishi (1988) who examined the use of Logp in a kindergarten classroom, 
and by Cochran-Smith (1991) in a review of word processing resean± with childrien. This 
research supports the assertion that technology is interpreted according to the relationships 
that exist in the classroom prior to the presence of the technology. 

\SHting and Technology 

Most research on writing with computers has concentrated on cognitive processes 
in isolation from particular writing contexts (Cochran-Smith, Paris & Kahn, 1991), while 
research on reading and technology has focossed on Computer-Assisted Instruction, such 
as reading improvement software (Balajthy, 1989). Neither of these approaches seems ade- 
quate when attempting to explain how a particular technology is integrated into the culture 
of a classroom. The kinds of changes that may occur are not likely to be captured if the focus 
of research is only on individuals and does not attempt to understand the classroom environ- 
ment. The manner in which an Lndividual child makes use of a computer will always be close- 
ly conneaed to the presence of other children and teachers, for it is the social relationships 
which exist in the classroom that will help us understand how and why things happen, 
whether or not they involve technology. 

As Cochran-Smith et al. (1991) state in their study of word processing and elementary 
students: 

Learning to write with computers and learning to teach writing with computers are 
qualitatively different experiences from learning with pencil and paper. ( p. 1) 

According to Cochran-Smith, word processing can lead to the u^e of new social arrange- 
ments involving collaboration and coaching, which in turn shape the theones and practices 
of writing in the classroom. Although there is little evidence that the quality of student rating 
changes when word processors are available, their smdy indicates that children may spend 
more time writing, and produce texts that are slightly longer than those created using pen 
and paper What is not dear from the study is whether students who have continuous access 
to computers use them differently than students who may use computers once a week in a 
computer lab, or who have a single computer available in their classroom. 

Literaq 

Lemke (1989) has described literacy as knowledge about a worid of texts, and making 
connections between them, both to understand and to be ui;derstood. Schooling can be 
seen as learning to master texts deemed important by a particular society. Barthes (1974) 
views text as just a set of potential meanings which are onh^ realized through the reader-text 
interaction. This interactiori is complex and greatly influenced, as Lemke notes, by other text 
with which a reader is familiar. For children accustomed to video games and television, their 
intenexaial worid stretches beyond the book to include particular charaaers and stories as 
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The opportunity to record 
arid analyze the public 
thoughts and writing 
activities of students is an 
advantage brought on by 
collaborative writing. 



Tools facilitating 
collaborative composing 
could be improved if 
designers understand what 
kinds of collaborations are 
valuable and how software 
design relates to use. 



StoryShow was conceived 
to help children construct 
stories that incorporate 
images and written and 
oral language. However 
this study indicates that is 
not necessarily how the 
software will be used. 



The software used a slide 
show metaphor Each slide 
can consist of an image, text 
and sounds. 
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well as particular ways of interacting with texts. 

Barthesdifferentiates between "readeriy" and "writeriy texts". The writeriy text gives the 
reader more room to maneuver, and the reader is more actively involved in creating mean- 
ing. With readeriy text, in contrast, the reader is left to accept or rejea what is presented, and 
meaning is often overiy-determined by the writer 

This distribution of power and control between text and reader, and the role it plays in 
how meaning is arrived at, seems a key point in understanding the reading and writing of 
children who are accustomed to different kinds of texts, such as video games, which may be 
seen as very ^Vmterty." A child interacting with a video game has a large amount of control 
over what happens as the game progresses. When the same children create or read text, simi- 
lar options may not always be available. When they are, as in the case of multimedia technolo- 
gies and computers, children may find the kinds of interactions possible a more natural 
extension of video games than books or other activities available to them. 

Computer Supported Cooperative Work 

In a review of tools for collaboration, Michael Schrage (1990) makes a distinction 
between increasing communication and increasing collaboration, and emphasizes that differ- 
ent tools are needed for collaboration. Schrage defines collaboration as shared discovery or 
shared creation, and shows that the need for collaboration is great when people deal wj.ch 
complex problems or when people with different areas of expertise need to work together 
Collaborative tools can help people produce something together that no one person could 
produce working alone. 

How tools are designed will influence the kinds of collaboration they encourage. The 
desk, according to Schrage, is designed for the individual working alone. The same could be 
said for most computer software, which usually assumes one user with one keyboard and 
one mouse working on one computer Tools for collaboration can help people develop what 
Schrage calls a "shared space." The shared space can be generated by people separated by 
time and distance, but it is through the use of the shared space that a collaboration will be 
shaped. Language is the primary way in \^Wch this shared understanding Ls developed, for as 
Schrage points out, language is the primary tool for collaboration. 

While not primarily focused on the collaborative aspects of software design, several stud- 
ies of word processing among children have considered how the use of computers for \\Titing 
encourages collaborative writing. Heap (1989) points out that collaborarive activity makes pri- 
vate cognitive processes public — students have to n^otiate the use of the computer, and 
development of a text, through language. For resear± purposes, the opportunity to record 
and aniyze the public thougiits and writing activities of students is ari advantage brought on 
by collaborative writing. Dickinson's study (1986) on the use of a computer for writing in a 
first-second grade classroom fixussed on the social structure that arose as the computer was 
used, and examined the planning, self-monitoring and response to ^Tiring that occurred as a 
result In this case the computer was intonated into the pre-odstirig writing curriculum and 
treated as another tool for writing by the teacher, but its use led to more opportunities for chil- 
dren to talk amor g themselves than was possible when they wrot.e with pencil and paper 
Both Dickinson and Heap looked at classrooms with one computer, and with word processing 
software designed with a single user in mind. In both cases, the (X)Operative aspects of com- 
posing are defined socially, and are not primary features of the vmting tools in use. Students 
collaborated because they chose to woiic together and because there was a shortage of tools. 

Neither of these studies provides a definition of collaborative text. Is a story written by 
one child with help fix)m a computer assistant collaborative in the same way that a story joint- 
ly composed by two students is? Certainly collaboration in wriiing can exist at a number of 
levels, but if better tools to facilitate collaborative composing are to be designed, there needs 
to be an understanding of what kinds of collaboration are valuable, and how softwareAool 
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This analysis discusses 
how students allocated 
composing tasks and how 
the social interactions that 
occurred when the software 
was used fit into the class' 
overall social structure. 
It also discusses the 
relationship between 
software design, intended 
use and actual use. 



Students weren't assigned 
specific tasks by the teacher 



Multiple techmlogies in the 
room allowed each students 
to play several roles. 



Donnie controlled the mouse 
pointing device for most 
events duing the 
composing process. However 
technical control didn t 
translate into content 
control. 
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design idates to use in classrooms. 

In tihis report we exaniine the use of StoryShow, a multimedia composing tool con- 
ceived to help young children construa stories that incorporate images, and written and oral 
language. It was designed for use by two students, although in this case it involved more, 
with particular features designed to encourage collaborative composing, editing and the 
sharing of tasks. ITie primary questions for this study are: 

• How does each child get to play the role of author? 

• How does the sharing cftasksreflea the sodai structure already existing in 
classroom? 

• How does the inteiided use of the software difefom how it is actually used 
the classroom? 

Method 

Hie research method employed in this study is miax>€thnographic Hie overall goal (rf 
the larger ACOT study, of which this report is one part, is to understand classroom learning 
activities from the point of view of the partidpants, to describe how innovative educational 
tools move from design to actual use, and to show how that knowledge may be applied to 
future designs. 

Setting 

This study took place in a second grade classroom in the Silicon Valley areaof California 
as part of long-term research conducted by the Apple Classrooms of Tomorrow projea of 
Apple Computer; Inc. Hie second grade teacher chose to participate in the field-testing d 
5to^ySm;, which had previously b^ 
ACOTschool. 

Hie teacher in this classroom, Ms. Boston, had been teaching for 29 years, induding the 
previous three years as an ACOT teacher She had become accustomed to teaching with tech- 
nology, and had made some adjustments because of it, but she was not as eager to use new 
software and hardware as some other teachers in the schocJ and preferred to have assistance 
when trying out new technologies. 

Hie schod population is drawn largely from middle to upper socioeconomic femilies, 
with many parents taking a strong interest in their child's schooling. In Ms. Boston's class 
there were 27 students, approximately 70 percent Anglo and 30 percent Asian. The five stu- 
dents parddpating in this study were chosen by the teacher, and the activities were condua- 
ed during the natural course of e\^ents in the classroom. 

Hie classroom itself was unique in terms of the amount of technology available to stu- 
dents and teachen d^t Macintosh* computers, three scanners, a laser printer, and a 
MacRecorder In addition, there were 16 ^ple n GS computers, eight dot-matrix printers 
and two video cassette recorders with color monitors. Another Macintosh, conneaed to a 
videodisc player, was shared with another classroom. 

Students used the computers for writing in journals, composing stories or drawing or 
creating animation. Computers were not used fior playing games in the classroom. Over the 
course of a day, students were likely to use a computer fix a total of about one hour 

Reading and writing activities were integrated in Ms. Boston's classroom. Children often 
read a particular type of stor^ as a group, an additional story on their own, then wrote their 
own stor^ on the same topic The open atmosphere in the classroom allowed students to 
move around relatively freely, so collaborarion of various kinds was likely to take place 
throu^out the day. Collaboration mi^t involve one student assisting another with a com- 
puter task, or with spelling, or could be a group activity with students reading aloud or acting 
out parts of a story. 



Multimedia Composingf€ 



Julie was recognized 
by the other students as the 
actiuity*s leader and she 
dominated content. 
Students turned to her for 
decision-making. 



Rick controlled the 
microphone, even when it 
wasnH in use. However, 
microphone control had 
little impact on content or 
participation. When she 
needed it, Julie physically 
took control of the 
microphone from Rick. 



The final slide show 
produced by the group is 
evidence of the cooperative 
nature of the composing 
process, but it masks the 
way students arrived at the 
final text. 
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lescriDtion of multimedia composing tool 

TTie primary activity obseived and recorded in this study was the use of the multimedia 
composing software StoryShow, during one morning session in Ms. Boston's classroom. The 
software was developed at Apple Computer, Inc. for several months before it was introduced 
in classrooms. SiorySxnv was conceived to help children construct stories that incorporate 
images and written and oral language. As this study indicates, that is not necessarily how it 
will be used i n classrooms. 

StoryShcw is presently designed to run on Macintosh computers with color monitors, 
integrating video capture, scanning, sound input, and texL Hie video, image scanning, and 
sound elements are provided througji additional devices attached to the Macintosh — an 8 
mm video camera connected to the Macintosh using a video capture board, an Apple fiad)ed 
scanner for images in books or drawn by hand on paper, and a MacRecorder for sound input - 
Each of these devices can be accessed directly fiomSfioryS^ Thesoft- 
ware uses the metaphor of a slide show, with each slide potentially consisting of an image, 
text, and sound The resulting multimedia text can be played back on the screen as a series of 
images, souTids, and text, and it can be saved to a videotape which can the^ 
video cassette recorder at home or in school. 

Initial testing was conducted informally on pairs of six and seven year old children. This 
was done early in the design and programming phase of the projea to ensure the program 
was not too complex for the target audience. Additional testing continued with first and 
fourth graders in vdunteer classrooms, and was ongoing during the time of this soidy. 
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StoryShow uses a slide 
show metaphor to 
combine text, im 'qes 
and sound. 



Jata Oodection 

The data for this soidy were colleaed over a five-week period and consisted of field 
notes bom observations d classroom activity, videotapes of soidents working in the ck;s- 
room and DSingStoryShow, a video taped ttace of what students produced on the computer 
screen, the computer files of their woric, and a taped interview with the teacher. 

The soidents in Ivls. Boston's class were initially introduced to StoryShow in a 60 minute 
demonstration. Several children participated directly, and the entire class chose pictures and 
sound that went into the final text The following week a group of six children built a multi- 
media composition DSingStorySbow, 

The soidents' next use of StoryShow, and the one reported in this soidy, occurred on a 
day when the classroom was being used as the background for a local television show about 



' A''n[xxtsc,'baninputclevx£Suppl(n)enarytoacomp^ fiidiiiatesthemanipulatkxicftcxiarKlinu^ 
indudesabutton,which w}^prcsed(r"dtcked"caus(sanactkn 
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Even in the cases where 
sounds or images were 
supplied by someone other 
than Julie, the ""director" she 
often had the final say as to 
what image was used and 
which sounds accompanied 
which images. 



The boys showed more 
interest in controlling the 
hardware than in actually 
choosing what went into the 
composition. Their language 
implied a link between 
device control and actual 
production that didn't exist. 
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computers and education. Students were assigned to StoryShow to illustrate the kinds of 
activities students carried out with computers. Filming for the television show lasted about 35 
minutes, with some disruptions, and StoryShow activity then continued for an additional 90 
minutes. 

The student woric group consisted initially of two boys, Rick and Donnie, and two giris, 
Julie and Amber A third giri, Mary, joined the group near the end of the activity. All students 
in this group are Anglo-American with the exception of Donnie, who is Asian-American. 

During data coOection I participated as a technical assistant to the children, correcting 
problems that came up during their use of the software. I tried to re&ain bom providing 
assistance on content questions entirely, and kept my technical help to the minimum neces- 
sary to allow the diildren to use the software. 

Data Preparation 

The videotapes of children woridng at the computer and the trace of their interactions 
with Lhe software were reviewed and categaized by the events, participant structures and 
contentproduced. I defined an event as bounded by the start of any activity designed to add 
a new element to the composition, and the completion or abandonment of that activity. I 
focused on who was operating each of the two main control devices (mouse, microphone), 
who provided die content during the given event, and who made the final decision on con- 
tent for that event. For content, I considered the use of the three elements available in each 
slide — image, sound, and text. 

The goal of this analysis was to understand how the students allocated composing tasks 
as they used the software, to understand how the social interactions that ocoirred while stu- 
dents used the software fit into the social structure of the classroom, and to consider the rela- 
tionship between the design and intended use of the software, and how it was actually used 
by students. 

Composing Episode 

Participant structures were examined in two ways — software control (use of the 
mouse), and content control (who selects what goes into the composition and who decides 
what actually gets saved as pan of the final produa.) The students were not assigned specific 
tasks by the teacher, but the presence of multiple technologies allowed each of the students 
to play various roles. In this case, both boys gravitated towards the computer while one of the 
girls, Julie, took control of the content. 

Donnie controOed the mouse during 37 of the 44 total events I identified in the compos- 
ing process, but this technical control did not translate into control over content or turn~tak- 
ing. Content was dominated by Julie, who initiated actions that staned 18 new events, and 
decided whether or not a particular sound or image would be saved for 38 of the 44 events 
(often sharing the decision with others.) Julie ms recognized by the other students as the 
leader of this activity, as they often aimed to her when a decision had to be made. This was 
consistent with other activities in the classroom, and Julie's skill as a leader was noted by Ms. 
Boston both during the time the group woriced with StoryShow and in an interview. During 
most of the composing process. Rick maintained control of the microphone, even when it 
was not in use. Control of the microphone had little impaa on content or participation, and 
when she needed it Julie physically took control of the microphone fiom Rick. 

The final slide show produced by the group gives evidence of the cooperative nature of 
the composing process, but through the presence of multiple authors, it tends to inask the 
wav in \\Wch students arrived at the final text. 
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As students progressed 
through the composition, 
more and more time was 
spent pre-editing. Images 
and sounds we^^? rehearsed 
and oriented catv^ : '\ before 
recording or capturing 



Colored icons represented 
actions controlling the 
software. In conversations, 
students referred more to the 
colors than the actions. 



While composing with 
StorySbow was clearly an 
extension of the usual 
reading and writing 
activities, it also required 
students to manage a variety 
of new roles. 



Even in the cases where sound or image input was supplied by someone other than 
Julie, she often had the final say as to what image was used or what sound went with the 
image. Fbr Mary and Rick, Julie provided assistance in selecting an image and coached them 
cn the exact content of their sounds by speaking the words herself and having the other 
child repeat them befbre attempting to record the final sound While this might seem an aa 
of dominating the content, in each case, Rick and Mary were not quite sure ^t to say or 
what to put in, and Julie's actions could be seen as those of a more able peer providing the 
scafifolding necessary for the other children to successfully complete the task. 

The following example illustrates the composing process used by this group. (In each of 
this example, I am identified as the 'Assistant"). In the first example we see how the students 
have strucDjred the process themselves. They have chosen to create a series of slides using 
books about rabbits they have read in class. 

Composing £;iomp:e — ProGuciion first sn'de 



Speaker What is said 

Donnia: Come on get some pictures. Where's the twoks? 

Julie and Amber get t)ooks and tiold Uiem in front of ttie can)era 

Julie: There it is. I want to hold it up (To Aml)er). 

Assistant: What do you guys want to do? 

Julie: Do the many rabbit stories of 

Mrs. Boston's class. 

Donnie: Get closer, get close. 

Juila: No, why don't we hold up. why don't we hold 

up all of the books in front of the camera? 

Juiie: (To Rick and Donnie) OK you guys grab a book. 

Donnie: I'm not, I'm taking pictures, 
mouse 

Julie: Grab a book! (emphatically) 

Rick: And I am making sounas 



Rsiatsd Actions 

Donnie using mouse 

Julie takes book 
Julie sets book down 



Julie backs away from 
camera 



Donnie still controls 
Amber gets a book 



Both boys here show more interest in having control of the hardware than in actually 
choosing what goes into the composition. Their language — "I'm taking pictures," and "I am 
making sounds" imply a link between control of the devices to create the pictures and 
sounds and the actual production ('making") of them that didn't really exist ('Mrs. Ellis' is 
the school's computer coordinator). 

Spsaksr What is said Rsiated Actions 

Julie: Grab two if you want to. 

Juiie: (To Rick and Donnie) Here, take two. Julie hands them books 

Juiie: Lefs all g<;t in front of the picture. 

All of these in front. 
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Everyone holds up books. Julie has organized the group to take the picture. 
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Taking a picture involved 
positioning a selected image 
in front of a video camera 
and pointing to the correct 
icon on the computer screen. 
The software froze the image 
fnnnjpTit^rilv oivifio ^tii/iptiVs 
an opportunity to quickly 
evaluate it. 


Speaker What is said Related Actions 

Julie: Uh oh, 1 have three. 

Rick: Let's call this the introduction. 

Rick and Donnie are holding their books up and they are blocking everything else 
Julie and 

Amber Rickl 




Julie: 


Can you hold this one? 




Ride 


It won't get, it won't fit. 


The software was designed to 
save Images auiomancauyf 
but offered a choice of saving 
or re-recording sound. 


Julie: 
Julie: 
Julie: 
Donnie: 


Well, we all put in. Donnie stands up. 

Donnie, your face is in the way. (laughing) 

Donnie. put the other one. the Peter Rabbit book in the front. 

How am 1 gonna take a picture though? 






1 Pt mp ^pp? 




Assistant: 


Who's gonna click the mouse? 




Donnie: 


Iwil!. 


Image editing generally took 
place before it was captured. 
Images once in the computer 
were rarely rejected or 
re-taken. 


Julie: 
Julie: 
Rick: 
Julie: 


Mrs. Ellis. Julie leaves 
Mrs. Ellis, could you, could you, could you? Points to computer 
All right, do it. 

Donnie. put up both of them. Mrs. Ellis's gonna do It. 




Donnie: 


lean hardly do this. 




Julie: 


Donnie. put up both of them. Put 'em together. 




David: 


Ah. what's this? This is crazy David wanders over 




David was not part of the group but happened to walk over to that part of the classroom 
astlieywereworkuig. 




Speaicer 


Wliat is said Related Actions 




Julie: 


Are they both in the picture? 




Rick: 


No. 




Mrs. Ellis: 


There. Standing next to computer 




Donnie: 


Take a picture. 




Ellis: 


Ready? 




Julie: 


No, wait. Can you see all the books? 
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However sounds recorded 
for each slide were more 
often rejected and 
re-recorded. For the final 
slide, students recorded the 
sound six times before 
saving it. 



Over the years, the teacher 
changed her teaching style to 
better suit her students, who 
commonly use interactive 
technologies such as video 
games and computers as well 
as the visually compelling 
mediums-television. 



Using as many different 
teaching methods became 
important to the teacher 
because one child might tune 
out sound but respond well 
10 visual information, while 
another has the opposite 
reaction. 
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TTiis is an example of the soa of attention to content and editing that took place, primar- 
fly as initiated by Julie, during the composing process. As they progressed through the com- 
position, more and more time was spent pre-editing, that is, images and sounds were 
rehearsed or oriented carefully before recording or ca^ Auring. 



Related Actions 



Couldn't find cursor 



Speaker What is said 

Assistant: Now click on the face, the face. 

Mrs. Ellis: Where's the mouse? What face, which face? 

Assistant On the yellow. 

Oonnle: This one. (points to yellow Icon of a face) 

Mrs Ellis: OK on the yellow. Got it. 



The students referred more to the colors of objects on the screen than to the icons which 
represented the actions that would be initiated by clicking those objects with the mouse. 



Speaicer What is said 

Mrs. Ellis: Ready? Tell me when? 

Julie: No. we don't have all the books in. 

Mrs. Eliis: There...now.Go. 

Picture is taken and appears on the screen after about five seconds 

Donnie: Do you like that? 

All: Yeah! 



Related Actions 



Makes adjustments w/books 



Using mouse 



While compasing with SiorySbow can be seen dearly as an extension of the reading and 
writing activities usually carried out in class — reading stories and then writing about them or 
aeating original stories on the same topic — it also required that students manage a variety 
of new roles. Julie initiated the event by distributing books and positioning the other stu- 
dents in front of the camera, and it was her idea to show several books in the picture as a way 
to capture what this composition was about ~ 'The Many Rabbit Stories of Mrs. Boston s 
Class." However, the successful completion of the image required the C(X)i:)eration of each 
student as well as the assistance of the school computer coordinator (Mrs. Ellis) who was in 
the room to help with the film crew. The process of taking the picture involved selecting aa 
image, framing it by arranging people and objects in front of the camera, then capturing the 
image by clicking the mouse on the appropriate button on the screen. At this pouir the cap- 
aired image freezed momentarily on the screen, where it could be evaluated by the students. 
Por each slide in this example, what might be decoibed as editing of a slide took place before 
the image w^as captured. Once an image had been put into the computer, it was usually saved 
as-is and rarely rejeaed or retaken. Sounds recorded for each slide in the show were more 
often rejeaed and re-recorded. 

It is interesting to note that the way sounds and images w-ere designed to be processed 
by the software, paralleled their use by the students. Recorded sounds were immediately 
played back by the computer, giving students the choice of saving or re-~recording the 
sounds. For ii ^e final slide in this example, students recorded the sound six times before sav- 
ing it. The software originally worked the same way for sound or images: once recorded or 
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Julie began the practice of 
discussing the sound first 
then practicing it befou^ 
attempting to record it. 
Immediate feedback from the 
computer seemed to make 
sound editing easier 



The way StoryShow was 
used related closely to 
the classroom 's social 
organization— especially in 
the roles students played. 



Independent work in this 
classroom was common. 
Students also worked in 
small groups, helping each 
other with both technology, 
and non-technology 
activities 
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aptured, the sound or image would automatically get saved into a bank of available sounds 
rid images for later placement Modification of the sound input Mtated editing by forcing 
a choice to save or reH:ecord the sound. 

The use of a trial run for sounds seems to have developed as a result of hesitations 
which came up during most of the recording? during the first session. Initially, the sounds 
were generated on the fly, as they were recorded During a second session, Julie b^an the 
practice of discussing the sound first, then practicing it before attempting to record it The 
immediate feedback fiom the computer seemed to make this editing easier, as children 
heard their woric right away, and then had the opdon to save it oi record it again. 

Another curious aspea of the use oiSlorySbow is ihe gender-felated differences in 
their diosen roles. Donnie and Rick were more interested in having control of the computer 
ihrou^ the mouse and microphone, and seemed less interested in adding content to d?e 
composition. Julie initiated die tunwaking that allowed everyone to have a role in content, 
aixl aldiough both Julie and Amber created two slides each, there was no resistance to this 
fium Rick or Donnie, who each created one. The same orientation to die composing process 
was apparent in other episodes in which tiiese students were involved, with both boys 
focused on controlling hardware while Julie had control of content and orchestration. 

In this classroom, as in the first and fourth grade classes, the way Sror^Stoz^ was used 
related closely to die sodal organization of die classroom, especially in die roles students 
played, dieir fimlom to move around, and ways of woridng: cooperatively, independendy, 
or for an audience. While Ms. Boston stated "I'm not terribly comfortable widi technology 
but I've gotten way more so," she also noted diat technology, bodi inside and outside her 
classroom, had had an effea on die way she taught At die outset of die ACOT program, Ms. 
Boston maintained a "lecture^ented" teaching practice. Students were allowed to become 
familiar widi die computer in a limited way, but it was mainly used to tutor or drill individual 
students woridng alone. Over die years, however, she changed her teaching style to better 
suit her students, who commonly use interactive technologies such as video games and com- 
puters, as well as die visually compelling medium of television, outside die classroom. ITiis 
led her to involve soidents in more physical ways in die classroom, using dramatization of 
stories where students aa out particular roles within a text, or choral speaking, where stu- 
dents share in die reading of books. In her opinion, a child might tune out sound but 
respond well to visual information, or vice versa, and providing as many opportunities as pos- 
sible became important to hen This change in teaching style, Ms, Boston remariced, is in part: 

...Because once again Vm in competition with what's going on outside the classroom, so 
I think I try to change activities so they're inmlved. Without technology, they're involved 
doing dramatization or in choral speaking or in coming up and doing an example 
But physically they're involved because I think physically they're involved in a lot of 
things outside the classroom. 

An additional change was diat die computer was no longer studied for knowledge of its 
components or fiinctions. Ms. Boston's students were akeady tutored in computer basics in 
die first grade, so most were already familiar widi the keyboard and had b^un to master 
touch typing. 

Independent woric in Ms. Boston's classroom was common. They wrote daily journals 
on die computer, and diey also helped each other by proofineading and offering suggestions. 
Students also woriced in small groups on computer-oriented tasks and diey helped each 
odier in bodi technology and non-technology activities. Ms. Boston used a process-oriented 
^proach to writing, with a chart on die wall listing various steps in die writing process as a 
guideline for children — pre-writing writing, revision, etc. In this'classroom, die process of 
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Different kinds of classrooms 
and teaching approaches led 
to different kinds of student 
collaborations. 



In Ms. Boston's class, all 
student editing happened 
during input. Software 
features allowing movement 
of slides and slide elements 
were not used at all by this 
group. 



Providing easy to use editing 
tools didn't encourage 
editing. The writing tasks 
students do need to require 
editing. 
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revision seemed to match Cochian-Smith (1991) — students correaed errors and added to 
the end of texts, but were less likel}^ to move text around or change parts of sentences. Ms. 
Boston said it was '^important that children write every day," and student work on journals 
and in writing their own stories was somethiing that went on every day in her classroom. 
Most of the computer use involved children using painting or writing programs at individual 
computers, with various kinds of helping and sharing of information, both about content and 
about how to use the computer. 

One of the ori^nal goals of the design of StoryShow was to build a compos ing tool that 
could be easily used by two students working together on the same project. Chooi>ing pro- 
jects and students was left to the teachers involved in this study, and one result was that dif- 
ferent kinds of classrooms and teaching approaches led to different kinds of collaborations 
among students using StoryShow, 
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Despite limited 
experience using 
StoryShow, students 
had little trouble 
importing images 
and sounds. 



In Ms. Boston's class, all student editing was at the point of input. Features in the soft- 
ware designed to enable the movement of slides and slide elements were not used at all by 
this group. These features occupied large amounts of development time, and were included 
to make possible the sorts of higher-level editing paralleled by the copy, cut. and paste fea- 
tures of word processors. Perhaps not surprisingly, although this group of students has high- 
ly developed skills for using the computer, their editing/revision strategies tended to be sur- 
fece le\d onK^ Even in writing with word processors they often made spelling corrections 
or added text to existing paragraphs or conmed sentences as they wrote them, but didn't 
move things around, or attempt to completely rewrite existing sentences. Ms. Boston said 
that students did do more revision of their work with the computer, but most of that activity 
centered around correcting spelling errors. As a result, it is not surprising that the editing fea- 
tures built in to StoryShow were not used. Again, classroom practice was the primary faaor 
in how the technology was actually used. A useftil question to consider is how existing prac- 
tice might be successftiOy combined with technology to encourage particular types of writing 
and composing activities that are seen as desirable, such as higher-level editing and revision. 
Attempting to encourage editing by providing tools to facilitate it is inadequate — the tasks 
saidents engage in need to require that editing be a desirable pan of the process. 

While existing classroom activities did not encourage much editing or revision of story 
elements, the classroom structure did seem to support the son of independent, student-<:en- 
tered group work that the Story9x)w activity permits, and students' experience with com- 
puters as well as working with each other seemed to facilitate the group pnxluction of text. 
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Students' experience with 
computers as well as 
working with each other 
seemed to facilitate the 
group production of text. 



Knowing their work would 
be shown to an audience 
played a role in how students 
structured their composition. 



Language is the medium 
through u xh students 
shared power and content 
Technology control was only 
a secondary feature of the 
collaborative process. 



Although students had very 
limited experience using 
StoryShow, they manage the 
process of importing sounds 
and images with little 
dijjkuliy. 



APPt£ Classrooms ofTomorrov 



They were accustomed to sharing tasks in latge group productions such as choral readings, 
and they had ejq^erience writing and sharing stories with the rest of the class. In the other 
two classrooms, students worthed only in pairs, and where the pairs were accustomed to 
working together things went relatively smoothly, but when they were un&miliar with each 
other's styles, the process was not as smooth. A larger group makes this kind of individual 
conflia less likely, although it also complicates the distribution of power in the composing 
process, as this report shows. 

Overall, the presence of an int^rated reading-writing program where students were 
accustomed to writing about things they read and sharing that with other students, as well as 
woridng together; seemed to facilitate the use of StoryShow in «r^eresting ways. This activity 
was seen as valuable by the students involved, in part because they were doing something 
that other students were not, but also because their w^ork was presented to the wliole class 
with the lights out. Knowing that an audience existed for their composition seems to have 
played a role both in the structure of their composition — an intrcxluctory slide announcing 
the content and a final slide identifying each author — as well as in their emphasis on getting 
each sound right and making sure it was cleariy audible. Their final slide took six tries before 
rhe sound was deemed acceptable by the group. 

While StoryShow was designed for two children working together, it really doesn't pro- 
vide any special tools to enhance the collaboration. Language, as Schrage (1990) noted, is 
ultimately the primary tool of collaboration. Certainly language is the medium through which 
students in this study shared power and content Contnd of the techndogy was only a sec- 
ondary feature of the collaborative process. Language was used to direa the content and the 
operation of the software, to accept or rejea images and sounds that became pan of the 
composition, and to plan each slide as it was construaed While the software can be seen as 
the focus of the process, language v^r^s really the tool of collaboration. 

Software Design 

Although students had only limited ejq^erience using the software, they were able to 
manage the process of importing images fix)m the video camera and record sounds without 
much difficulty. To a large extent, the software did not get in the way of their activity. 
However, there were several instances where moving fixim one "mode" to another was con- 
ftising. For example, they emptoyed a consistently linear process when constructing their 
composition — they moved from slide # 1 througji to slide #9 one by one. first capturing an 
image and then adding a sound to the image. No text was used for any slides. Breakdov.TC, 
defined as instances where production or manipulation of an element was interrupted by a 
problem with the software, seemed to occur when students moved fixDm image apture to 
sound recording, a procedure which involved clicking on specific buttons to dose the video 
camera and return to the slide editing area On several occasions students opened a new 
window to capture an image on one monitor, then moved back to the main slide window 
without dosing the capture window, causing the software to ftinction incorrectly. In addition, 
this movement necessitated the dragging of a screen window fi^m one monitor to anodier 
each time. IWs process is initially very disorienting, as it involves moving an objea between 
two screens which are physically separate. When the objea is dragged to the right edge of 
one screen, it then appears on the left edge of the second screen, which is several inches 
away bom the first screen. Use of the second screen was necessary to allow videotaping of 
screen interactions as well as the use of the video capture for images. A more el^ant solu- 
tion might be to incorporate the image capture directly into each individual slide to avoid the 
mode switching and perhaps facilitating faster construction of the compositfons. 

Because these children did no editing other than to reject particular images or sounds 
and retake or re-record them, the switching from capture to edit mode served no purpose 
other than to confiise them. 
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Because these children did 
no editing except for 
refecting certain images or 
sounds and re-taking or 
re-recording them, the 
software feature allowing 
users to switch between 
capturing and editing mode 
confused the students. 



The software shows 15 slides 
in small form. Images are 
1120th original size and text 
and sounds appear only as 
icons on individual slides. 
Children never 'clicked' on 
these slides Jo view or hear 
the slide because editing 
decisions were made at the 
point of import. 



If the software were 
re-designed so small slides 
were replaced by large 
images with image, sound 
and text controls, the 
editing process may 
become easier 
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Asecond feature of the software which was not used at aU again rdates to 
of the sEde images. An initial screen shows 15 slides in small torn — images are approod- 
mately 1/20 original size, and text and sounds appear only as icons on individual slides. 
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To view or hear the slide, one can double-click the mouse on the image or part of the 
slide. In this study, that operation was not peifonned even once. Editing decisions were 
made at the point of impcxt — when an image was grabbed using the camera 
ture software/hardware, it was either accepted or rejeaed Hie same procedure was fol- 
lowed for sounds. 

Again, redesign of the software could make this process easier by eliminating the use of 
the smaU sHdes and filling each saeen with the original size image alon^ 
ture controls, sound controls and text area. Image, not text, predominates in the design of 
the software, so a redesign that incorporates text more prominently might increase the use 
of written language by younger children. 

With most software, files are saved with names given by the user of thie software. 
Instead, StoryShow generates names for each image, sound, and text, and each of these 
objects are l^t as sniafl icons at the lx)ttom of the screen to be ai^ 
dragging the image up to the sEde. For images and text, this works well, as the icon usually 
provides a visible due as to what the entire image or text is — a shrunken picmre or the first 
few words of the texL For sounds, the visual representation oflfers no due as to the content, 
making browsing through sounds a tedious process of listening to each one entirely. What is 
needed is a way to sample the first two or three seconds of the sound Lacking this, the size 
of the sound is represented by icons whfch show more waves coming out of a speaker to 
indkate longer sounds. (See figure below.) 




shorter sound 



longer sound 
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The software was designed 
for images A re-design that 
incorporates text more 
prominently might increase 
the children's use of written 
language. 



The iconic delineation on 
stored sounds offered no clue 
about content, making 
sound browsing tedious. An 
ability to sample initial 
seconds of sounds might 
encourage browsing. 



Features enabling students to 
collect, browse and assemble 
tended to be ignored by 
students All composing was 
done one slide at a time. 
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This feature, and others with a "coUea-browse-assemble" orientation tended to be 
ignored by students. Instead, all composing was done one slide at a time. A picture was cap- 
tured and saved, followed by a sound. This eliminated the need to bro\^'se through images 
and sounds, and aigues for a redesign of the software to better fit the composition stvde of 
the students. 

Collaboration and StoryShow 

As a collaborative tool, StoryShow functions reasonably well in an environment where 
collaboration is already common. The presence of multiple input devices, and multiple roles 
for participants, allow groups of up to five or six children to woric together on a composition. 
What is dear is that the collaboration is tied to the social setting in which the software is used 
and is not an outgrowth of any particular design features aimed at encouraging collaboration. 

In a first grade classroom where students were less accustomed to woridng indepen- 
dently and were paired as a result of completing an assignment first rather than by choice, 
the software was used one at a time, with each child creating a single slide as the other 
watched or assisted with reading of the text, or correcting spelling errors on the screen. This 
kind of coUaborauon is similar to that among the first graders using word processing software 
described by Heap (1989). When one student has final control over content, whether for the 
text of a story or for the image, sound, and text in an individual slide, it is not dear that anoth- 
er student assisting with input or corrections is realty collaborating as a coauthor To call such 
interactions collaboration may honor the work of the assistant too higfily. Collaboration at 
the level of content seems a different matter than sharing the task of typing. In Heap's study 
and others like it, collaboration is part of the social strucrare of the classroom that permits it 
to happen, but it often occurs beause there is a limited amount of technology, often one 
computer per classroom. Such a set-up almost requires that children work together if 
enough students are to master the computer, on whatever software is available. Designing 
software specifically for collaborative woric will require attention both to the writing practices 
of classrooms as well as an understanding of the Idnds of social relationships that exist 
among students and teachers in classrooms. 

This report was part of a larger study of the introduction of multimedia software 
designed for use by pairs of children. In each of the three classrooms where the study was 
conduaed, students used StoryShow to construa presentations rather than stories, and in 
Ms. Boston's classroom, students woriced in groups of four to six rather than in pairs. A num- 
ber of &aors contributed to how the software ultimately was used, induding how it was 
interpreted by individual teachers, how well it fit into the ongoing reading and writing activi- 
ties of the classroom, and how students chose to use it. \X1iile the software design can be 
seen as successful fiiom a technical perspective beause students in first, second, and fourth 
grades were all able to use it with very limited instruction, a doser look at actual use suggests 
that technical mastery is not dosely tied to using software in ways that are interesting or 
involve children in reading and wTiting in new ways. 

The presence of advanced technology for creating multimedia compositions requires 
curriculum support that gives students a sense of how to combine different media effectively. 
Given the extremely limited presence of multimedia composing tools in schools, it is unlikely 
to expea teachers to easily integrate such tools into classrooms which still tend to focus on 
paper as the primary medium of communication, whether as part of writing, drawing, or 
word-processing activities. 

Software designed for particular audiences and tasks will be used in way's that are sup- 
ported by the context rather than by the software. In this case, what mattered most was not 
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While software design can be 
seen as successful from a 
technical perspective 
because first, second and 
fourth graders used it after 
limited instruction, technical 
mastery isn't closely tied to 
using software in ways that 
are interesting or involve 
children in reading and 
writing in new ways. 



the presence of expensive computer hardware and the software to altow students to create 
multimedia compositions, but a classroom environment which supported the kinds of inde- 
pendent and collaborative activities that th^: software made possible. Without a supportive 
environment, the software was little more than an objea of Ssdnation for bringing together a 
variety of new technologies, and permitting students to replicate their work in a new medium. 

Discussion 

As Mehan (1989), Cochran-Smith (1991), Hawkins (1987) and Genishi (1988) have 
shown, technology is not always the key element when considering how a partia^Jar hard- 
ware or software innovation actually gets used by students. Hie classroom is a social environ- 
ment with a variety of relationships, norms, and practices which exist prior to the introduc- 
tion of a new technology. How a new technology is used owes as much to the ongoing activi- 
ties of the classroom as it does to any particular features of the technology. 



What matters most isn't 
the amount of technology 
available, but a learning 
environment that supports 
independent and 
collaborative activities. 



How a new technology is 
used owes as much to the 
on-going activities of the 
classroom as it does to any 
particular technology 
feature. 
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Note: All names in this report are pseudonyms. 
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